Resetting in stochastic optimal control
نویسندگان
چکیده
``When in a difficult situation, it is sometimes better to give up and start all over again.'' While this empirical truth has been regularly observed wide range of circumstances, quantifying the effectiveness such heuristic strategy remains an open challenge. In paper, we combine notions optimal control stochastic resetting address problem. The emerging analytical framework allows one not only measure performance given restarting policy, but also obtain for class dynamical systems. We apply our technique system with final reward show that value must be larger than critical threshold effective. Our approach, analogous celebrated Hamilton-Jacobi-Bellman paradigm, provides basis investigation realistic strategies across disciplines. As application, can applied epidemic model predict lockdown policy.
منابع مشابه
Type-II phase resetting curve is optimal for stochastic synchrony.
The phase-resetting curve (PRC) describes the response of a neural oscillator to small perturbations in membrane potential. Its usefulness for predicting the dynamics of weakly coupled deterministic networks has been well characterized. However, the inputs to real neurons may often be more accurately described as barrages of synaptic noise. Effective connectivity between cells may thus arise in...
متن کاملDiffusion with stochastic resetting.
We study simple diffusion where a particle stochastically resets to its initial position at a constant rate r. A finite resetting rate leads to a nonequilibrium stationary state with non-Gaussian fluctuations for the particle position. We also show that the mean time to find a stationary target by a diffusive searcher is finite and has a minimum value at an optimal resetting rate r*. Resetting ...
متن کاملStochastic Optimal Control in Finance
Preface These are the extended version of the Cattedra Galileiana I gave in April 2003 in Scuola Normale, Pisa. I am grateful to the Society of Amici della Scuola Normale for the funding and to Professors Maurizio Pratelli, Marzia De Donno and Paulo Guasoni for organizing these lectures and their hospitality. In these notes, I give a very quick introduction to stochastic optimal control and the...
متن کاملStochastic optimal control theory
Control theory is a mathematical description of how to act optimally to gain future rewards. In this paper I give an introduction to deterministic and stochastic control theory; partial observability, learning and the combined problem of inference and control. Subsequently, I discuss a class of non-linear stochastic control problems that can be efficiently solved using a path integral. In this ...
متن کاملPathwise Stochastic Optimal Control
This paper approaches optimal control problems for discrete-time controlled Markov processes by representing the value of the problem in a dual Lagrangian form; the value is expressed as an infimum over a family of Lagrangian martingales of an expectation of a pathwise supremum of the objective adjusted by the Lagrangian martingale term. This representation opens up the possibility of numerical...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical review research
سال: 2023
ISSN: ['2643-1564']
DOI: https://doi.org/10.1103/physrevresearch.5.013122